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(57) ABSTRACT 

Method and system aspects for increasing storage capacity 
in a digital image capture device are described. Compression 
levels of saved image files are utilized to increase storage 
capacity by identifying a level of compression of a saved 
image file in the digital image capture device. The identified 
level of compression is compared with a predetermined level 
of compression, and the saved image file is compressed to 
the predetermined level of compression when the identified 
level of compression does not match the predetermined level 
of compression to free storage space in the digital image 
capture device. 

17 Claims, 6 Drawing Sheets 
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METHOD AND SYSTEM FOR INCREASING 
STORAGE CAPACITY IN A DIGITAL IMAGE 
CAPTURE DEVICE 



FIELD OF THE INVENTION 

The present invention relates generally to an image cap- 
ture device and more particularly to a method and system for 
increasing storage capacity on demand in an image capture iQ 
device. 

BACKGROUND OF THE INVENTION 

In general, modern digital cameras for taking pictures of 
scenes and the like typically include an imaging device 15 
which is controlled by a computer running a single threaded 
process. When an image is captured, the imaging device is 
exposed to light and generates raw image data representing 
the image. The raw image data ,is typically stored in a single 
image buffer where it is then processed and compressed by 20 
the processor. Many types of compression schemes axe used 
to compress the image data, with the joint photographic 
expert group (JPEG) standard being the most popular. After 
the processor processes and compresses the raw image data 
into JPEG image files, the processor stores the JPEG image 25 
files into an internal memory or on an external memory card. 

While digital cameras do alleviate the hassles of using and 
developing film that are required by film-based cameras, 
digital cameras are not without their share of concerns. One 
main concern is the maintenance of storage space in the 30 
digital camera. Most users desire the ability to take images 
on an instant's notice. Inherently, a limitation exists due to 
the cameras storage capacity. Even with the use JPEG 
compression techniques to efficiently utilize storage, users 
are often hampered when taking an image as a result of a 35 
lack of storage space. Thus, the ability to efficiently increase 
the storage capacity in a digital camera is highly desirable. 

Accordingly, a need exists for a convenient and efficient 
manner of increasing storage capacity in an image capture 
unit. The present invention addresses such a need. 40 

SUMMARY OF THE INVENTION 

The present invention provides aspects for increasing 
storage capacity in a digital image capture device. Com- 45 
pression levels of saved image files are utilized to increase 
storage capacity by identifying a level of compression of a 
saved image file in the digital image capture device. The 
identified level of compression is compared with a prede- 
termined level of compression, and the saved image file is 5Q 
compressed to the predetermined level of compression when 
the identified level of compression does not match the 
predetermined level of compression to free storage space in 
the digital image capture device. 

Through the present invention, the ability to increase 55 
storage space in a storage device of a digital image capture 
unit is achieved. Thus, on-demand image capture is success- 
fully supported with reduced risk of a lack of storage space. 
These and other advantages of the aspects of the present 
invention Will be more fully understood in conjunction with 60 
the following detailed description and accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a block diagram of one preferred 65 
embodiment of a digital camera is shown for use in accor- 
dance with the present invention. 
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FIGS. 2A and 2B are diagrams depicting exemplary 
hardware components of the camera's user interface. 

FIG. 3 is a diagram illustrating the operation and appear- 
ance of the user interface when the camera is placed into 
review mode. 

FIG. 4 illustrates a diagram of one embodiment for an 
image file. 

FIG. 5 illustrates a diagram of one embodiment for the 
image tags. 

FIG. 6 illustrates a block flow diagram of a method for 
increasing storage capacity in accordance with the present 
invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

The present invention relates to a method and system for 
increasing storage capacity in a digital image capture device. 
The following description is presented to enable one of 
ordinary skill in the art to make and use the invention and is 
provided in the context of a patent application and its 
requirements. Although the present invention will be 
described in the context of a still digital camera, various 
modifications to the preferred embodiment will be readily 
apparent to those skilled in the art and the generic principles 
herein may be applied to other embodiments. That is, any 
digital imaging capture device which captures, stores, or 
displays digital images, could incorporate the features 
described hereinbelow and that device would be within the 
spirit and scope of the present invention. Thus, the present 
invention is not intended to be limited to the embodiment 
shown but is to be accorded the widest scope consistent with 
the principles and features described herein. 

Referring now to FIG. 1, a block diagram of one preferred 
embodiment of a digital camera 110 is shown for use in 
accordance with the present invention. Camera 110 prefer- 
ably comprises an imaging device 114, a system bus 116 and 
a computer 118. Imaging device 114 includes an image 
sensor, such as a charged coupled device (CCD) or a CMOS 
(Complementary Metal Oxide Semiconductor) sensor, for 
generating a set of raw image data representing a captured 
image. In a preferred embodiment, system bus 116 provides 
connection paths between imaging device 114, an optional 
power manager 342, central processing unit (CPU) 344, 
dynamic random-access memory (DRAM) 346, input/ 
output interface (I/O) 348, non-volatile memory 350, and 
buffers/connector 352 that connect an optional removable 
memory 354 to system bus 116. 

CPU 344 may include a conventional microprocessor 
device for controlling the operation of camera 110. In the 
preferred embodiment, CPU 344 is capable of concurrently 
running multiple software routines to control the various 
processes of camera 110 within a multithreaded environ- 
ment. For example, images may be captured at the same time 
that previously captured images are processed in the back- 
ground to effectively increase the capture rate of the camera. 
In a preferred embodiment, CPU 244 runs an operating 
system that includes a menu-driven GUI (graphical user 
interface) and provides image processing through software, 
rather than hardware. An example of such software is the 
DIGITA Operating Environment by FlashPoint Technology 
of San Jose, Calif. Although CPU 344 is preferably a 
microprocessor, one or more DSPs (digital signal processor) 
or ASICs (Application Specific Integrated Circuit) could 
also be used. 

I/O 348 is an interface device allowing communications 
to and from computer 118. For example, I/O 348 permits an 



04/15/2004, EAST Version: 1.4.1 



US 6,564 

3 

external host computer (not shown) to connect to and 
communicate with computer 118. I/O 348 also interfaces 
with a plurality of buttons and/or dials 404, and an optional 
status LCD 406, which in addition to the LCD screen 402, 
are the hardware elements of the camera's user interface 5 
408. 

Non-volatile memory 350, which may typically comprise 
a conventional read-only memory or flash memory, stores a 
set of computer-readable program instructions to control the 
operation of camera 110. Removable memory 354 serves as 10 
an additional image data storage area and is preferably a 
non-volatile device, such a flash disk, readily removable and 
replaceable by a camera 110 user via buffers/connector 352. 

Power supply 356 supplies operating power to the various 
components of camera 110. Power manager 342 communi- 15 
cates via line 366 with power supply 356 and coordinates 
power management operations for camera 110. In the pre- 
ferred embodiment, power supply 356 provides operating 
power to a main power bus 362 and also to a secondary 
power bus 364. The main power bus 362 provides power to 20 
imaging device 114, I/O 348, non-volatile memory 350 and 
removable memory 354. The secondary power bus 364 
provides power to power manager 342, CPU 344 and 
DRAM 346. 

Power supply 356 is connected to main batteries 358 and 
also to backup batteries 360. In the preferred embodiment, 
a camera 110 user may also connect power supply 356 to an 
external power source. During normal operation of power 
supply 356, the main batteries 358 provide operating power 3Q 
to power supply 356 which then provides the operating 
power to camera 110 via both main power bus 362 and 
secondary power bus 364. During a power failure mode in 
which the main batteries 358 have failed (when their output 
voltage has fallen below a minimum operational voltage 35 
level) the backup batteries 360 provide operating power to 
power supply 356 which then provides the operating power 
only to the secondary power bus 364 of camera 110. 

Dynamic Random-Access-Memory (DRAM) 346 is a 
contiguous block of dynamic memory that may be selec- ^ 
tively allocated for various storage functions. DRAM 346 
stores both raw and compressed image data and is also used 
by CPU 344 while executing the software routines used 
within computer 118. The raw image data received from 
imaging device 114 is temporarily stored in several input 45 
buffers (not shown) within DRAM 346. Once the raw image 
data is processed, it is stored in a frame buffer (not shown) 
for display on the LCD screen 402. In a preferred, 
embodiment, the input buffers and the frame buffer are split 
into two ping-pong buffers to improve the display speed of 50 
the digital camera and to prevent the tearing of the image in 
the display 402. After processed image data has been stored 
in DRAM 346, LCD controller 390 transfers the image data 
to LCD screen 462 for display. 

FIGS. 2A and 2B are diagrams depicting exemplary 55 
hardware components of the camera's user interface 408. 
FIG. 2A is back view of the camera 110 showing the LCD 
screen 402, a four-way navigation control button 409 
(including up/down buttons 411a, 4116), an overlay button 
412, a menu button 414, and a set of programmable soft keys go 
416. FIG. 26 is a top view of the camera U0 showing a 
shutter button 418, and a mode dial 420. The camera may 
optionally include status LCD 406, status LCD scroll and 
select buttons 422 and 424, a sound record button 426, and 
zoom-in, zoom-out buttons 426a and 426b. 55 

The camera operates in at least two modes, capture mode 
for capturing images, and play mode for playing back the 



,282 Bl 

4 

captured images on the LCD screen 402. Further preferably 
included is a review mode. 

Referring now to FIG. 3, a diagram illustrating the 
operation and appearance of the user interface when the 
camera is placed into review mode is shown. The review 
mode enables the user to view all the images in the camera 
along with specific attributes associated with each of the 
images. 

The review screen layout is based on a filmstrip metaphor 
which allows users to quickly move forward and backward 
among pictures chronologically. In a preferred embodiment, 
several small-sized versions of the captured images, called 
thumbnails 700, are displayed in a row across the LCD 
screen 402. The user may scroll through the series of 
displayed thumbnails 700 in the LCD screen 402 using the 
four-way navigation control button 409. The direction of 
scrolling is capably mapped to the horizontal left/right 
buttons 410a and 4106. When the user presses the left/right 
buttons 410, the thumbnails 700 are scrolled-off the LCD 
screen 402 and replaced by new thumbnails 700 represent- 
ing other captured images. 

A stationary selection arrow line 702 is used as both a 
navigational aid and to indicate which thumbnail is the 
currently selected image. When there are more than four 
images in the camera, the selection arrow line 702 displays 
arrow heads to indicate movement in that direction is 
possible with the left/right navigation buttons 410. As the 
user presses the navigation buttons 410 and the thumbnails 
700 scroll across the LCD screen 402, the thumbnail 700 
that is positioned over a notch in the selection arrow line 702 
is considered the selected image. 

When a thumbnail 700 becomes the selected image, 
additional information corresponding to that image is auto- 
matically displayed. In a preferred embodiment, the addi- 
tional information includes a large thumbnail 704 showing 
a larger view of the selected thumbnail, and image infor- 
mation comprising an icon bar 706 and text 708. The icon 
bar may display several icons indicating the media types 
associated with the active image, such as whether the image 
is a still, a time lapse, or a burst image, whether sound is 
attached to the image, and a category for the image. The 
displayed text 708 may include a specification of the name 
or number of the image, and the date and time the image was 
captured. 

FIG. 4 illustrates a diagram of one embodiment for an 
image file 835. Image file 835 includes a header 805, image 
data 810, a screennail 815, a thumbnail 820, and image tags 
825. 

Header 805 preferably includes information that identifies 
and describes the various contents of image file 835. Image 
data 810 contains actual captured image data. Image data 
810 exists in whichever format that is appropriate for the 
current location of image file 835 within the image process- 
ing chain of the camera 110. Screennail 815 and thumbnail 
820 are each different versions of image data 810 that have 
varying degrees of reduced resolution for a number of 
special viewing applications. 

Image lags 825 include various types of information that 
correspond and relate to particular captured image data 810, 
as discussed in conjunction with FIG. 5. 

Referring to FIG. 5, a diagram of one embodiment for the 
image tags 825 is shown. In the FIG. 5 embodiment, image 
tags 825 include capture information tags, user tags 715, 
product tags 720, and automatic category tags 735. Capture 
information tags 710 preferably include various types of 
information that correlate with the capture image data 810. 
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For example, capture information tags 710 may indicate the storage recovery procedure employs the alternative 

focus setting, aperture setting, and other relevant iaforma- compression algorithm to further compress a stored image 

tion that may be used for effectively processing or analyzing file to the predetermined level. The identification of the level 

the corresponding image data. User tags 715 include those 0 f compression is capably done by identifying a file exten- 

labels a user specifies for a given image, often referred to as 5 s { on that indicates compression, such as ".jpg" for JPEG 

'stamps', such as 'birthday* or 'vacation*, etc., that aid in fii es or t> v looking in the file header. Once the predetermined 

personal categorization of the images. Product tags 720 compression level has been reached, the process continues 

typically contain various other information, such as camera ^ a next filCj ^ delermiaed via step m6> until 

110 manufacturer. enough storage space has been freed, or there are no more 

Automatic category tags 735 result from analysis of the 10 stored files mat further compression. In this 

image data, such as described in co-pending U.S. patent man ner, an increase in the storage capacity of a digital 

application, Ser. No. 09/121,760, entitled "System and camera is achieved. 

Method for Automatic Analysis and Categorization of „ ., ( . «- * (1 • . • «- ♦ , 

w p. • « . * • j i Thus, the present invention efficiently maintains sufficient 

Images in an Electronic Imaging Device, assigned to the . r . • «n_-i *u i i c 

. & - . . ' *r\ n « 0 - storage space for capturing an image. While the level of 

assignee of toe preset invention, and filed Jul. 23, 1998. For 1S B re J on for , ^ J file ^ described „ , 

example individual image analysis may generate automatic ^ £ for identifying files that are processed 

category tags 735 based on detection of a person or groups : , r7.. . A . « . 

: 6 7 ^ 4 . t . 4 . . z i to produce additional storage space, the designation may 

of persons according to characteristics, like substantial . *V , -c « u c i 

r t cn . , -.u- .u • . . also be done more specifically by a user. For example, a user 

amounts of flesh tones within the image. Category tags , . _ • «i .£ . .-it t_ • • J ■ *i_ 

... r , . . c , ^ 6 ' ^ may know that certain files that are still being carried in the 

resulting from detection of nature scenes from nn J . ^ „ , . . r ~ 

, . . i • i . . • .i_ ■ 20 camera have actually been copied/archived. Thus, a user 

characteristics, like substantial green content in the image • j ■ j ■ 

.,L .i. i *• i 7 c u j j I could tag these files when viewed m review mode, such as 

combined with the relative lack of hard edges, are also A , , & . . i_-l.--.jj. 

... . ... .jo* *i i . • i*i through a menu selection item, as highest priority candidates 

possibly automatically generated. Similarly, categories like f ,® . ~ , . - z.. . 

*V . . • ■ j * if j . . j for further compression. Conversely, certain files could also 

city miages, water images, or indoor images may be detected . . . r ., r ' . 

■ l* . . f * .-j-.u • he tagged as unavailable for further compression, such as 

by characteristic features contained in those images. nt - . °z • j ■ , t . . . i. r. L • 

' , - , . , . ««« 25 when it is desired to maintain the quality of the image. Of 

In the processing of the digital images in camera 110, to me ^ of FIG 6 would then ^ , ^ check 

conserve storage space, compression techniques are rou- fof fi , es ^ ^ , he rfori to form th(J additional 

ttnely employed such as JPEG compression techniques. ^^0,, on ^ files flrst and a check t0 deten mne 

Compression techniques normally are chosen based on a whether ^ flle Qas been marked „ unavailable for &Ither 

balance between the time needed to perform the compres- 30 compression. Hus, the ability to increase storage is adaptive 

s.on and the amount of data loss during compression. , 0 accommo d a te user's inputs. 

Usually, higher quality compression techniques, i.e., more ..... . . .. . . 

lossless techniques, take longer to perform. While storage Although the present ^invention has been described in 

space is conserved through compression, conserving enough **ordance the embodiments shown, one of ordinary 

storage space in camera 110 for at least one image is always 35 sk ^ m tbe a " "*°JP"« that there could be 

desirable to ensure that at any moment, a desired image is v ^ h0 F« 10 embodiments and those variations would be 

able to be captured. Accordingly, in the present invention, withn me spirit and scope of me present invention. It should 

maintaining sufficient storage space is achieved for a digital be ? ppr 5" a J c * '^i alth ° Ugh _ P art,cular mention has been 

camera made of JPEG file formats, the present invention is suitable 

n e • . n*-* a a j- -ii * . n use with any file format, not just JPEG. In addition. 

Referring to FIG. 6, a now diagram illustrates an overall 40 Ct _ • . j- . \. 

-° * . c j * ci software written according to the present invention may be 

sequence for producing storage space from saved unage files , . . J. , J .. 

. , ... 4 . mi 1 1 . . stored on a computer-readable medium, such as a removable 

ui accordance with the present invention. The method ini- . -.j ^ . jijj-. l 

r , , , ... memory, or transmitted over a network, and loaded into the 

hates once a storage recovery procedure has been enabled, ,. , r . . .. . 

asdetermined via slep 1000. By way of example, insufficient f.^ tal c, ? era f ° r » e ^»°°- Accordmgly, many modifica- 

c . . t «. j **i tions may be made by one of ordinary skill m the art without 

storage space for an image may not be discovered until an 45 j * ■ • • , J - it _ , , . . 

. ' 1 . * . 1 t 1 departing from the spirit and scope of the appended claims, 

attempt is made by a user to take an image. In accordance What is claimed is* 

with one embodiment, therefore, the decision to initiate - . ' . 4 . . , . 

storage recovery occurs when a user responds affirmatively ' method for producing storage space in a digital image 

& * ■ -j j u ha capture device, the method comprising: 

to an appropriate prompt that is provided by the camera 110 ' v b 

when there is not enough storage space for a current attempt 50 W^-^W, a level of compression of a saved image 

to capture an image. Alternatively, the storage recovery mc m ^ ca P mrc device i 

procedure may be initiated as a continuous background (P) comparing the identified level of compression with a 

process through selection of a menu item or another appro- predetermined level of compression; 

priate selection means by a user when setting up an image (c) compressing the saved image file to the predetermined 

capture session. 55 level of compression when the identified level of com- 

Once enabled, the storage recovery procedure continues pression does not match the predetermined level of 

with examination of stored image files to determine whether compression to free storage space in the digital image 

the stored image file has been compressed to a predeter- capture device; and 

mined compression level (step 1002). If the image file has (d) performing steps (a), (b), and (c) in response to 

not been compressed to the predetermined level, the image 60 insufficient storage space during an image capture 

file is compressed to the predetermined level (step 1004). session. 

For example, as previously mentioned, JPEG compression 2. The method of claim 1 further comprising performing 

techniques are often employed to compress image data steps (a), (b), and (c) as a background process in the digital 

before storage. Thus, most image files will be stored as image capture device. 

compressed JPEG files. However, further compression of 65 3. The method of claim 1 further comprising selecting the 

the image file is possible via alternative 115 compression performance of steps (a), (b), and (c) by a user during the 

techniques, such as wavelet compression algorithms. Thus, image capture session. 
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4. The method of claim 1 wherein the identified level of 
compression results from compression according to a JPEG 
compression algorithm. 

5. The method of claim 1 wherein the predetermined 
compression level results from compression according to a 5 
wavelet compression algorithm. 

6. The method of claim 1 further comprising repeating 
steps (a), (b), and (c) for each digital image saved in the 
digital image capture device. 

7. A method for reclaiming storage space in a digital 10 
image capture device during an image capture session, the 
method comprising: 

initialing capture of a digital image; 

identifying insufficient storage space for the digital image 

in the digital image capture device; 15 
determining whether a storage recovery procedure is 

desired; and 

reclaiming storage space through the storage recovery 
procedure from at least one saved digital image file 2 o 
when the storage recovery procedure is desired. 

8. The method of claim 7 wherein the storage recovery 
procedure further comprises: 

(a) identifying a level of compression of a saved image 
file in the digital image capture device; 25 

(b) comparing the identified level of compression with a 
predetermined level of compression; and 

(c) compressing the saved image file to the predetermined 
level of compression when the identified level of com- 
pression does not match the predetermined level of 30 
compression to free storage space in the digital image 
capture device. 

9. The method of claim 8 further comprising repeating 
steps (a), (b), and (c) until enough storage space has been 
reclaimed to store the digital image. 35 

10. The method of claim 8 wherein the identified level of 
compression results from compression according to a JPEG 
compression algorithm. 

11. The method of claim 8 wherein the predetermined 
compression level results from compression according to a 40 
wavelet compression algorithm. 
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12. The method of claim 8 furtherer comprising desig- 
nating an image file as unavailable for the storage recovery 
procedure. 

13. A system for increasing storage capacity in a digital 
image capture device, the system comprising: 

storage means for storing digital image data captured with 
the digital image capture device; and 

processing means for processing the digital image data to 
form digital images, wherein the processing means 
identifies insufficient storage space for a digital image 
in the digital image capture device during an image 
capture session initiated by capture of a digital image, 
determines whether a storage recovery procedure is 
desired, and reclaims storage space in the storage 
means through the storage recovery procedure from at 
least one saved digital image file in the storage means 
when the storage recovery procedure is desired. 

14. The system of claim 13 wherein the processing means 
performs the storage recovery procedure by: 

(a) identifying a level of compression of a saved image 
file in the digital image capture device; 

(b) comparing the identified level of compression with a 
predetermined level of compression; and 

(c) compressing the saved image file to the predetermined 
level of compression when the identified level of com- 
pression does not match the predetermined level of 
compression to free storage space in the digital image 
capture device. 

15. The system of claim 14 wherein the processing means 
repeats steps (a), (b), and (c) until enough storage space has 
been reclaimed in the storage means to store the digital 
image. 

16. The system of claim 15 wherein the identified level of 
compression results from compression according to a JPEG 
compression algorithm. 

17. The system of claim 15 wherein the predetermined 
compression level results from compression according to a 
wavelet compression algorithm. 

***** 
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